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Given a closed, bounded convex set W C R'' with nonempty in- 
terior, we consider a control problem in which the state process W 
and the control process U satisly 

Wt = wo+ [ ^{Ws)ds+ [ (j{Ws)dZs + GUteW, t>Q, 



where Z is a, standard, multi-dimensional Brownian motion, i?, a £ 
C°'^(W), G is a fixed matrix, and wo £ W. The process U is locally 
of bounded variation and has increments in a given closed convex cone 
U C R^. Given g G C(W), k e W, and a > 0, consider the objective 
that is to minimize the cost 



J{wo,U)=E / e'°"g{Ws)ds+ / e"°" • [7, 

-Jo -^[0,00) 

over the admissible controls U. Both g and k ■ u (u £U) may take 
positive and negative values. This paper studies the corresponding 
dynamic programming equation (DPE), a second-order degenerate el- 
liptic partial difi'erential equation of HJB-type with a state constraint 
boundary condition. Under the controllability condition GIA = K'' 
and the finiteness of H-iq) ~ sup^^g^^^ {— Gtt ■ q — n ■ u }, qe R'', where 
Ui = {u £U : \Gu\ = 1}, we show that the cost, that involves an im- 
proper integral, is well defined. We establish the following: (i) the 
value function for the control problem satisfies the DPE (in the vis- 
cosity sense), and (ii) the condition inf^g^d TL{q) < is necessary and 
sufficient for uniqueness of solutions to the DPE. The existence and 
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uniqueness of solutions are shown to be connected to an intuitive "no 
arbitrage" condition. 

Our results apply to Brownian control problems that represent 
formal diffusion approximations to control problems associated with 
stochastic processing networks. 



1. Introduction. This paper studies a class of singular control problems 
for diffusions with state constraints. Such a problem involves finite dimen- 
sional processes denoted by W and U, referred to as state and control pro- 
cesses, respectively. They satisfy 

(1.1) Wt = wo+ f'^{Ws)ds+ f' a{Ws)dZs + GUt, t > 0, 

Jo Jo 

where W and U are adapted to a filtration for which Z is a standard multi- 
dimensional Brownian motion, ■!? and a are Lipschitz continuous functions 
and G is a fixed d x p matrix {d < p). The sample paths of the control U 
are RCLL (right continuous with finite left limits), and they are locally of 
bounded variation. In addition, these sample paths have increments in a 
given closed convex cone U C MP. By "state constraints" we mean that for 
a control to be regarded as admissible, it is required that the corresponding 
state process stays for all time within a given closed, bounded convex set 
W C K'^ that has a nonempty interior. For existence of admissible controls, 
we need the following controllability condition which is assumed throughout: 

(1.2) the set GU = {Gu :u£K} equals M''. 

The control problem consists of minimizing a cost of the form 

/•oo r 

/ e~'''g{Ws)ds+ e-'^'diK-Us) 

Jo J[0,oo) 

over all admissible controls U . Here, g \s a, continuous function, k is a fixed 
vector in and a > 0. One of the main new aspects in this work is that 
K ■ u may take both positive and negative values for different uGU, hence, 
the cost definition involves an improper integral (see [1] for a related treat- 
ment involving only proper integrals and for additional references on singular 
control of diffusions with state constraints). Define 



(1.3) J{wo,U)=E 



(1.4) 7i{q) = sup {—Gu • q — K • u}, q£ 



id 



where lAi = {u^U: \ Gu\ = 1} and | • | denotes the Euclidean norm on M'^. 
We assume throughout that 

(1.5) H{q) < oo for some q G R'^, 

(equivalently, for all g G M'^, see Lemma A.l in the Appendix). This assump- 
tion ensures that the integrals and expectation in (1.3) are well defined, and 
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that an integration by parts formula is valid for the last integral in (1.3), 
as shown in Lemma 2.1. Note that (1.2) implies that Ui is nonempty and, 
thus, using (1.2) and (1.5), we have that Tiiq) G (—00,00) for all q G W^. 
Our main goal is to study existence and uniqueness for the corresponding 
Dynamic Programming Equation (DPE) 

(1.6) {{C + a)^l;-g)vn{Di;) = 0, 

with a boundary condition stipulating that the (viscosity sense) solution is 
a supersolution up to the boundary (this is known as the state constraint 
boundary condition). Here, for a smooth function / defined on W, Df de- 
notes the gradient of /, D^f the Hessian matrix of /, Cf = —^tra,ce{aa'D'^f) — 
'd ■ Df. Because of the way the boundary condition is set, it is seen to be 
redundant if the function Ti. assumes only nonnegative values, and therefore 
one might expect the condition 

(1.7) inf n{q) < 

to be important for uniqueness of solutions. Our main result (Theorem 2.1) 
establishes that the value function of the control problem satisfies the DPE 
and that (1.7) is necessary and sufficient for uniqueness of viscosity solutions. 
We then investigate the role played by the condition 

(1.8) {uGU -.Gu = and K-u<0} = {0}, 

that we refer to as a "no arbitrage" condition (following the terminology for 
an analogous condition. Assumption 2.2 of [7], that we restate here as As- 
sumption 3.2). This condition (1.8) states that there is no nontrivial control 
that maintains the current state without incurring an immediate increase in 
the cost. Lemma A.l shows that (1.5) can be written in the following equiv- 
alent form, which is a slightly weaker condition than (1.8) (see Lemma A. 2): 

{u eU:\Gu\ < £ and k-u< -1} = 

(1.9) 

for all e > sufficiently small. 

In particular, under (1.9), there exist solutions to the DPE. We also show 
(in Theorem 2.2) that (1.8), together with a mild condition on the cone U 
(2.15), implies (1.7), thus providing a sufficient condition for uniqueness of 
solutions for the DPE. Example 2.1(a) shows where (1.9) (and in 

particular, existence of solutions) holds, while (1.8) (and uniqueness) fails. 

A principal motivation for this paper comes from a family of models 
referred to in the literature as Brownian control problems (BCPs), that 
arise as formal diffusion approximations to control problems associated with 
stochastic processing networks. We refer the reader to [6] for a detailed 
account on relationships between stochastic processing networks and BCPs. 
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In [7] the BCPs introduced in [6] were shown to be equivalent to singular 
control problems of the form studied in the current paper. A key assumption 
for this equivalence is what we have stated here as Assumption 3.2. A simple 
argument shows that this assumption, in fact, implies (1.8) (cf. Lemma 3.1). 
Consequently, our results provide a characterization of the value function 
associated with the singular control problem of [7] as the unique solution of 
a corresponding DPE (cf. Theorem 3.1). 

We now comment on some aspects of the technique. The proof that the 
value function of the control problem is a solution of the DPE (1.6) with a 
state constraint boundary condition is obtained by establishing a dynamic 
programming principle (DPP) (see Proposition 4.1). For a class of singular 
control problems with state constraint, a similar DPP was recently obtained 
in [1]. The proof there crucially used certain monotonicity properties of the 
singular control term in the cost (see the proof of Lemma 8.1 of [1]) that are 
not valid in the current formulation. To treat the more general form of the 
cost function considered in the current paper, we give a different (and more 
direct) proof that does not appeal to monotonicity requirements. 

It is well understood that an appropriate framework for second order 
degenerate elliptic equations, of which the DPE (1.6) is a special case, is 
through the theory of viscosity solutions. The paper [3] gives an excellent 
tutorial on the subject. However, typical comparison results in this theory 
which are used to argue uniqueness of solutions rely on a key coercivity 
property which is usually unavailable for DPEs corresponding to singular 
control problems. More precisely, writing the equation (1.6) in the form 
F{x, -0, DiIj, D^^) = 0, x€W, for a suitable F : W x M x M"' x S(d) M, 
where §{d) denotes the space of symmetric d x d matrices, the standard 
coercivity condition (see [3], equation (3.13)) requires, for some 7 E (0,oo), 

F{x, r, q, X) — F{x, s, q, X) > ^{r — s) 

for r>s, {x,q,X)£W xM"^ x§{d). 

This condition is clearly not satisfied, in general, for F as in (1.6). As sug- 
gested in Section 5C of [3], the existence of a strict subsolution to (1.6) (i.e., 
a subsolution defined with a strict inequality, uniform over W) may be used 
as a substitute for coercivity in the comparison argument. As noted earlier, 
condition (1.7) is necessary and sufficient for uniqueness. The role it plays 
in the comparison proof is precisely by enabling the construction of a strict 
subsolution to (1.6). 

The proof that (1.7) follows from the no arbitrage condition (1.8) and (2.15) 
is surprisingly indirect (see Theorem 2.2). Although these conditions are 
purely algebraic (involving only G, k and U), we have not found a direct 
proof. Our proof, in fact, relies on regularity of the value function of the 
control problem (1.1)-(1.3) (and perturbations thereof). 
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The paper is organized as follows. In Section 2 we present the basic setup 
and the main result (Theorem 2.1) showing existence of solutions for the 
DPE and giving necessary and sufficient conditions for uniqueness of solu- 
tions. We also establish the finiteness and Lipschitz continuity of the value 
function, and show how the hypothesis for uniqueness can be verified by 
means of the no arbitrage condition (1.8) and (2.15). Section 3 describes the 
connection of the control problem formulated in Section 2 with the reduced 
Brownian control problem identified in [7] , and characterizes the value func- 
tion of the latter in terms of the DPE. The latter is done by verifying the 
conditions of the main theorem. Section 4 is devoted to the proof of the DPP 
and establishing the solvability of the DPE by the value function. Finally, 
in Section 5 we establish uniqueness via a comparison result (Theorem 5.1), 
formulated for a class of equations that is, in fact, more general in terms of 
conditions on W and TC than that of Section 2. 

The following notation and terminology will be used. 

We shall use c, ci , C2 , . . . to denote positive deterministic constants whose 
values may change from the proof of one result to another. For a,(3 € M", |a| 
denotes the Euclidean norm of a, and a ■ (3 denotes the usual scalar product 
between a and (3. The operator norm of a matrix M will be denoted by 
\M\. Let -Be(x) = {y eW^ :\x — y\ < e} and let denote the unit sphere 

in M". For a set A C M", A° [A, dA] denotes the interior [resp., closure, 
boundary] of A. The infimum over an empty set is regarded as -|-oo. For 
a set S C M", C{S) [(7^(5)] denotes the space of continuous [resp. twice 
continuously differentiable] real valued functions defined on S. 

For a function / : [0, oo) — > M" and t > 0, we write \ f\t for the total varia- 
tion of / over [0, t] with respect to the Euclidean norm, defined by 

\f\t = 1/(0)1 + sup|e \f(*i) - ■0 = to<ti<---<ti=t,l>l^, 

and I/I* = sup^g[o,t] l/('5)l- A function from [0,00) to some Polish space E is 
RCLL if it is right-continuous on [0, 00) and has left limits in E on (0,oo). 
When E C M", for such an RCLL ^ denote A^{t) = ^(t) -^(t-) for t > 0. As a 
convention, we set A^(0) = C(0). The space of all RCLL functions from [0, 00) 
into E is denoted by 'D{[0,oo),E) and is endowed with the usual Skorohod 
topology. The space of all continuous functions from [0, 00) into E is denoted 
by C{[0,oo), E) and is endowed with the topology of uniform convergence 
on compacts. A function u : [0, 00) — > is said to have increments in a set 
U if ii(0) G U and u{t) - u{s) G for all < s < t < 00. 

An n- dimensional process is a measurable map from a measurable space 
(ri,^) to I?([0, oo),M"), and a process is an n-dimensional process for some 
n. A continuous process is a process having continuous sample paths almost 
surely. For a process X, we use the notation X{t) and Xt interchangeably. 
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A filtered probability space is aquadruple {^l,Q,{Qt},Q), where {Q,Q,Q) is 
a probability space and {Gt} is a filtration, that is, a family of sub-c-algebras 
of the fj-algebra Q indexed by i £ M_|_ and satisfying Gg C Qt whenever < 
s < t < oo. An n-dimensional process X = {X{t) : t G M+} defined on such a 
filtered probability space is said to be adapted if for each t>0 the function 
: — > M" is measurable when Q has the cr-algebra Gt and M" has its 
Borel (T-algebra. 

Given a positive integer n and a filtered probability space {Q, Q, {Gt},Q), a 
process Z defined on this space is said to be an n-dimensional {Gt} standard 
Brownian motion if it is a continuous, adapted n-dimensional process such 
that: 

(i) Zq = 0, Q-a.s., and 

(ii) for < s < t, under Q, the increment Zt — Zg is independent of Gs 
and is normally distributed with mean zero and covariance matrix (t — s)/, 
where / stands for the n x n identity matrix. 

2. Setting and main result. Let A; be a given positive integer. We say that 
$ = (A, ^, {^f}, Q, Z) is a system if (A,G,{Gt},Q.) is a filtered probability 
space endowed with a fc-dimensional {^f}-standard Brownian motion Z. We 
consider a control problem in which the state process is to remain in a given 
closed, bounded, convex set W C that has a nonempty interior, and the 
control process is to have increments in a given nonempty closed convex 
cone U gMP, where d and p are given positive integers satisfying p> d. A 
dx p matrix G specifies the linear effect of this control process on the state 
process. Conditions (1.2) and (1.5) [recall the definition of H given in (1.4)] 
are assumed throughout this paper. The drift and diffusion coefficients are 
denoted by -i?, a function from W to W^, and a, a function from W to the 
space of d X k matrices, respectively. Throughout, and a are assumed to 
be Lipschitz continuous on W. 

Definition 2.1. Given k,d,p,yV,l(,G,'d,a as described above, an ad- 
missible control for the initial condition wq €W is a p-dimensional adapted 
process U defined on some filtered probability space ($7, G, {^t}, P) for which 
there exists a d-dimensional adapted process W and a fc-dimensional {Gt}- 
standard Brownian motion Z, such that the following three properties hold 



P-a.s.: 



One has 



(2.1) 




t>0; 



(iii) 
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U is locally of bounded variation and has increments in U; 
W{t) £ W for ah t > 0. 
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We call W the state process corresponding to the control U. The class of all 
admissible controls for the initial condition wq will be denoted by A{wq). 

Since U is a convex cone, we have Ut GU for all t>0, a.s. Also, it is easy 
to see that A{w) is nonempty for all w G W (see proof of Proposition 2.1). 

Remark 2.1. Note that when we select U € A{ujq), it is implicit that 
U carries with it a filtered probability space {Q,Q,{Qt},^) and processes 
W, Z. Expectations under P will be denoted by E and we shall often write 
a.s. instead of P-a.s. 

Let K gMP and a G (0, oo) be given. The cost criterion will involve an 
improper integral in the form of the right-hand side of equation (2.3) below. 
Note first that for ah wo^W,!/ € A{wo) and t>0, 

(2.2) a f\-"'K-Usds + e-''*K-Ut= f e-°"d(K-[/,) a.s. 

Jo J[0,i] 

Here we recall the convention that the contribution to the integral on the 
right-hand side above at time zero is k ■ Uq. This identity was previously 
noted in [7] (see Lemma A.l there which follows from Theorem 18, page 278 
and Theorem 8, page 265 of [5]). The following lemma ensures that our cost 
functional is bounded below and that integration by parts holds on [0, oo). 



Lemma 2.1. (i) One has 

sup sup E 



'{K-Us)-ds 



< oo. 



(ii) The limit limt-,oo J[Q t] ^ '^'^d{K-Us), denoted as /[qoo)^ °"'d{n-Us), 
exists as an improper integral a.s. with values in (—00,00], for each wq^W 
and U £A{wq). Furthermore, the following ^integration hy parts'"^ formula 
holds: 

/•oo /■ 

(2.3) a e-'''K-Usds= e'^^'diK-Us) a.s. 

JO J[0,oo) 

Note that the integral on the left-hand side of (2.3) is well defined a.s. 
(possibly taking the value +00) by the first part of the lemma. 

Proof. From (1.5) and Lemma A.l we have that for some ci £ (0,oo), 
(k • u)~ < ci\Gu\ for all u gU. Thus, from (2.1) and compactness of W, we 
have, for U S A{wo), 



E 



e-°'(K-C/,)"ds 
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(2.4) 



<ciE 



<ci 



Jo Jo 
(2c2 + ||i?||ws + ||o"||waA) ds 



ds 



where C2 = sup{|w|:u' G W}, ||'!?||w = sup{\'&{w)\:w G W}, ||o"||>v = 
sup{|(t(w)| -.w S W} and we have used an L^-isometry for stochastic inte- 
grals to obtain one of the bounds. Since the last integral above is finite and 
independent oi wq gW and U £ A{wo), (i) holds. The proof of (ii) follows 
the argument given in Lemmas 3.2 and A. 4 of [7] and for completeness is 
included in the Appendix. □ 

Let (7 : W — > M be a continuous function. For wq &W and U G A{wq), let 
the associated cost be defined as 



(2.5) 



J{wo,U)=E 



e-'''g{Ws)ds + 



[0,oo) 



' d{K. ■ Us 



In view of Lemma 2.1(ii), we have the following equivalent representation 
for the cost: 



(2.6) 



J{wo,U)=K 



/ e-'''g{Ws)ds + a e'^^K-Usds 
Jo Jo 



In view of the boundedness of (7 on W and Lemma 2.1(i), J{wo,U) is 
bounded below uniformly for wq £ W and U G A{wq). The value function is 
defined as 



inf J{wo,U), woeW. 
UeAiwo) 



(2.7) V{wo) 

The following elementary lemma will be used at several places. 



Lemma 2.2. There is a Borel measurable function w.W^ ^lA and G 
(0, 00) such that Gw{x) = x and \vj{x)\ < Ct^\x\ for all x G M'^. 

Proof. Let {ei}f^i be an orthonormal basis in M*^. Prom (1.2) there 
exist f^,ff G U such that Gf^ = Ci and Gf~ = — Cj, i = I, . . . ,d. Therefore, 

d 
i=l 

satisfies all of the desired properties with = dm.axf^^{\fj^\ V | /■"!). □ 

Let C^(VV) denote the set of twice continuously differentiable functions 
defined from W into M. Let P = aa' and, for / G G^{W), let 



Cf{x) = --tmce(T{x)D^f{x)) - ^{x) ■ Df{x) 
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The following proposition gives some basic properties of the value function. 



Proposition 2.1. For each wq G W, the value is finite, that is, V{'Wo) £ 
(—00,00). The value function l/iW— >M is Lipschitz continuous, that is, 
there exists a constant c\\p G (0,oo) such that, for all wi,W2 S W, |y(u;i) — 
V{w2)\ < ciip|t(;i - W2\. 

Proof. Note first that V{wq) > —00 for wq € W is immediate from 
Lemma 2.1(i). To show that V{wq) < 00, consider first wq € W°. Let B = 
Bs{wo), where e is so small that B C W. Let n{w) denote the inward unit 
normal to B at if € dB. Considering a stochastic differential equation with 
normal reflection field on the boundary of B, the results of [8] (see also 
[10]) show that there exists a system $ = {A,Q,{Gt},Q,Z) and continuous, 
adapted processes W and £ such that, a.s., Wt £ B for all i > 0, ^ is contin- 
uous and locally of bounded variation, 

(2.9) Wt = wo+ f'^{W,)ds+ f' a{Ws)dZs + et, t>0, 

Jo Jo 

(2.10) it = j\{w.^QB}n{Ws)d\e\s, t>0. 
Define a continuous, adapted process U such that, a.s., 

Ut = J^ l{W,edB}^{n{Ws))d\i\s. 

It follows from Lemma 2.2 that (2.1) is satisfied. Also, Definition 2.1(iii) 
holds clearly, and U satisfies part (ii) of Definition 2.1 since U is convex, 
and so U £ A{wq). Let 



(u;) = -(2e) ^\w-wo\'^ 



Note that (p is bounded on B and satisfies n ■ V(/> = 1 on dB. Ito's formula 
applied to (2.9) shows that, a.s., 

(2.11) (p{Wt) = 4>{wo) - t C(p{Ws)ds + Mt+ f'vcP{Ws)-d£s, 

Jo Jo 

for C as in (2.8) and a continuous martingale 

M = I^J^V(t>iWs) ■ a{Ws) dZs,t> 
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that starts from 0. Using (2.10) and the fact that n ■ \/<j) = 1 on dB, the 
last term of (2.11) is equal to \i\t, and therefore, IE[|-^|t] < C(l + 1) for an 
appropriate constant C not depending on t since cj) and jOcf) ^-rs bounded 
on B. As a result, a similar bound holds for E[|C/(|], and it follows that 
V{wo) < oo for wqGW". 

We now consider Lipschitz continuity on the interior and finiteness on 
the boundary. The first property is essentially a consequence of (1.2) and 
Lemma 2.2 since they imply that the state process can be moved from any 
wi £W to any other W2 G W, instantaneously, by exercising a control and 
paying a cost that is bounded by a constant times \wi — W2\ - More precisely, 
fix wi G W° and W2 G W. Given e £ (0,oo), let U € A{wi) be such that 
V{wi) < J{wi,U) < V{wi) + e. Note that U{t)£U for all t > 0, a.s. Let 
u = ^{'Wi — W2) and define U = u + U . Clearly, U G A{w2) (we use the fact 
that lA is convex and a cone for this). Also, 

V{w2) — V{wi) < J{w2, U) — J{wi, [/) + e = K • u + e < Crol^l |wi — W2I + 

Letting e — > 0, it follows that the Lipschitz property holds on W° and that 
V is finite on the boundary. The argument above can now be repeated to 
deduce the Lipschitz property on all of W. □ 

Recall the notation 7i{q) from (1.4) and that Ti.{q) G (—00, +00) for ev- 
ery q gW^. The following partial differential equation of Hamilton- Jacobi- 
Bellman type will be associated with our control problem: 

(2.12) {{C + a)^-g)yn{D^j) = 0, 

with an additional state constraint boundary condition. The precise defi- 
nition of a solution for this equation with boundary condition is as a con- 
strained viscosity solution of (2.12) on W, defined in the following way (the 
form of the boundary condition was introduced by Soner in the paper [9]; 
that paper also contains an explanation on how the boundary condition was 
derived for the state constraint problem). 

Definition 2.2 (Constrained viscosity solution). 

(i) For S C W, V is said to be a viscosity supersolution [resp., subsolu- 
tion] of (2.12) on S if "0 is a continuous real valued function on S and for all 
w £ S and all if G C^(«S') for which i/j — if has a global minimum [maximum] 
on 5 at one has 

{Cifiw) + atl;{w) - g{w)) V n{Dip{w)) > [< 0]. 

(ii) A function ip -.W ^M. is said to be a constrained viscosity solution 
of (2.12) on W if it is a viscosity subsolution of (2.12) on >V° and a viscosity 
supersolution of (2.12) on W. 
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The latter condition in (ii) corresponds to the boundary condition. We 
remark that the definition above is equivalent to one in which the terms 
"global minimum" and "global maximum" are replaced by "local minimum" 
and, respectively, "local maximum," as is easy to see; this will be used in 
the sequel several times. Our main result characterizes the value function as 
a constrained viscosity solution of (2.12) on W. 

Theorem 2.1. (i) Solvability. V is a constrained viscosity solution of 

(2.12) on yV. 

(ii) Uniqueness. Condition (1.7) is necessary and sufficient for V to he 
the only constrained viscosity solution. 

Proof. Part (i) of the theorem follows from Propositions 4.2 and 4.3 
below, whereas part (ii) is established in Corollary 5.1. □ 

The following simple example illustrates the effect of condition (1.7) on 
uniqueness. 

Example 2.1. (a) Let W= [0,1], U = m.\, G= [1,-1], i? = 0, a = 0. 
Note that (1.2) is satisfied in this example. An admissible control U = 
{Ui,U2)' is nondecreasing in both coordinates and constrains W{t) to W 
for all i > 0, where 

W = WQ + GU = WQ + Ui- U2. 
Let 9 = 0, a = 1, and k = [kqi —i^o]'-, 1^0 G (0, 00). Then 

(2.13) ti-U = KQ{Ui-U2) = tiQ{W -wq). 

It is then easy to see that V{w) = —kqw. Equation (2.12) on (0, 1) is equiv- 
alent to -0 V ^{{Dil}) = 0, where 

Ti^q) =s\\]i{—qGu — k{u) -.u ^Ui}., g E M, 

K,{u) = Ko{ui — U2) and Ui = {u^ : \ui — U2I = 1}. Thus, 

Hiq) = sup{(ui - U2){-q - kq) -.u eR'^,\ui - U2\ = 1} = \q + ko\. 

In particular, (1.5) is satisfied. We show that ■0(tt;) = —kqw — c is a con- 
strained viscosity solution of (2.12) on W for every c > 0. On (0,1) the 
function ^ satisfies the equation classically, and as is well known, this is 
sufficient for it to satisfy the equation in the viscosity sense [3] and hence 
to be a viscosity subsolution and supersolution of (2.12) on W°. Let us 
demonstrate that the boundary condition holds. If ip £ C^(W) is such that 
tp — <p has a global minimum at u; = 0, then D(p{{)) = —kq — ci, where ci > 0. 
The condition to be verified, (— c) V | — ci| > 0, clearly holds. So does the 
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condition to be verified at w = 1, that is, (— — c) V |ci| > 0. Thus, ip is a 
constrained viscosity solution of (2.12) on W for every c > 0. The equation 
thus has multiple solutions. Note that in this example (1.7) is not satisfied. 

(b) Consider now the case where k = [2kq, —kq]', kq G (0,oo). Once again, 
V^w) = —kqw. Also note that, for (7 G M, 

H{q) = sup{ — (ui — U2)q — ko{2ui — U2) : u G M^, \ui — U2\ = 1} 

= sup{(tii — U2){—q — Kq) — uii^o - u G M^, |ui — U2I = 1} 

= iq + hq) V {-q - 2ko). 

Hence, 7i{-) assumes both positive and negative values, and so (1.7) holds. 
Also, (2.12) for this problem can be written as 

(2.14) V V n{Di;) = V (L>V + Ho) V (-L>V - 2ko) = 0. 

From the uniqueness statement of Theorem 2.1 it follows that V is the 
unique constrained viscosity solution of (2.14). Also, note that each of the 
functions 'tp{w) = —kqw — c, c > satisfies the equation classically on (0, 1), 
while only for c = the boundary condition is satisfied. Indeed, for these 
functions, the boundary condition at w = and, respectively, w = 1 reads 
(— c) V (— ci) V (ci — Kq) > and {—kq — c) V ci V (— kq — ci) > for every 
ci > 0, which holds if and only if c = 0. 

Next, we study some relations between the no arbitrage condition (1.8) 
and the hypotheses of Theorem 2.1. A condition similar to (1.8) was used in 
[7] in proving the existence of admissible controls and finiteness of the value 
function for the control problem therein. We note that there are cases covered 
by Proposition 2.1 and Theorem 2.1 in which the no arbitrage condition does 
not hold. This is the case in Example 2.1(a) in which, as mentioned above, 
our standing assumptions (1.2) and (1.5) hold, while (1.8) and (1.7) fail. 

We now show that the no arbitrage condition is, in fact, useful in verifying 
(1.7). We introduce the following additional condition: 

(2.15) there exists a unit vector ui G W such that inf ui ■ u> 0. 

By (1.2), inf{|u| : u £U, \Gu\ = 1} is strictly positive and, thus, a sufficient 
condition for (2.15) to hold is that there is a vector ui G for which 

inf ui ■ u> 0. 

u£U:\u\ = l 

Indeed, 

inf ui ■ u = inf ui ■ - — Aul > 6 inf ui ■ - — r = 6 inf ui ■ u, 

u&lAi neWi |n| u&A\{0} \u\ u&A:\u\=l 

where 5 = inf{|M| :ueU, \Gu\ = 1}. 
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Theorem 2.2. Let conditions (1.8) and (2.15) hold. Then (1.7) holds. 

The proof of the theorem is presented below Corohary (2.1). 

A weaker version of the no arbitrage condition (1.8) is (1.9). The lat- 
ter condition is in fact equivalent to (1.5) (cf. Lemma A.l). We thus have 
two sets of sufficient conditions for existence and uniqueness of solutions of 
the DPE: In terms of the Hamiltonian 7i [(1.5) for existence and (1.7) for 
uniqueness], and in terms of no arbitrage considerations [(1.9) for existence 
and (1.8) and (2.15) for uniqueness]. 

Remark 2.2. (a) Note that in Example 2.1(a), (2.15) is satisfied and, 
thus, from Theorem 2.2, (1.8) fails. However, the "weak no arbitrage" con- 
dition (1.9) holds in this example since it is equivalent to (1.5). 

(b) Condition (1.8) is in fact strictly stronger [under (2.15)] than (1.7) as 
the following example shows. Let W = [Q,l], U = W{, G = [1, -1,0], ?? = 0, 
(7 = 0, K = [2ko, — kq, 0]'. It is easy to see that 7i is the same as in Exam- 
ple 2.1(b) and thus (1.7) holds. However, (1.8) clearly fails. 

The following corollary is an immediate consequence of the theorem. 

Corollary 2.1. Under the hypotheses of Theorem 2.2, V is the only 
constrained viscosity solution to (2.12) on W. 

Proof of Theorem 2.2. For k g W, let 

£{k) = {li g : Gn = and k • u < 0}. 

Note that (k) is always nonempty as it contains {0}. From condition (1.8) 
we have that S{k) = {0}. Next we show that {k S : <S(/5) = {0}} is an open 
set. This is equivalent to showing that F = {k G ■.£{k) ^ {0}} is closed. 
To this end, let Kn be a sequence of vectors in F which converges to k* . Let 
ti„ 7^ be in £{Kn) for each n. Noting that the set <f (k) is a cone, we can 
assume, without loss of generality, that = 1 for all n. Also, by choosing a 
subsequence if needed, we can assume that converges to some unit vector 
u* G U. Note that Gu* = 0. Since Kn ■ Un ^ k* ■ u* , we have k* ■ u* < 0. This 
shows that £{k*) 3 u* j^O and, as a result, k* G F. Hence, F is closed, and 
we thus have the following: 

there is eo > such that £{k) = {0} whenever |k; — k| < Eq. 

For e G (0,eo), let = k — eui, where ui is as in (2.15). By the above 
display, £{k^) = {0}. Define V^{-) by (2.7) with Jiwo,U) defined by (2.6) 
with K replaced by . Note that condition (1.8) holds with k replaced by 
K^. Consequently, by Lemma A.l and since (1.8) implies (1.9), (1.5) holds 
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with K replaced by . In particular, applying Proposition 2.1 with k and V 
replaced by and , we see that V^{w) G (—00, 00) for all w G W and 
is Lipschitz continuous. Next, let C S C^(W) be a nonnegative function on 
W with C = on dW and sup^gyy C(^) > 0. Such a function can be easily 
constructed by choosing a nonnegative (but not identically zero) function 
that is twice continuously differentiable with compact support in the interior 
of W. Let M = max„,g>v V^{w). Define 

a = inf(/?>0: inf {M + 1 - PCiw) - V (w)) < o] . 

Clearly, a is finite, inf^„gw;(M + 1 — aC(w) — V^{w)) = 0, and there exists 
w €W° such that M + 1 - aC(t(;) - V^w) = 0. Define = M + 1 - aC. 
Then ^/^(w) = 99(71;) and V^{wq) < (p{wo) for all wq £ W. For all 5 > small 
enough, one has w + 5Gu £ W° for all u £Ui. Using Lemma A.3(i) in the 
Appendix, with V replaced by , we obtain, for all > sufficiently small, 

Lp{w + 6Gu) - Lp{w) >V''{w + 5Gu) - V''{w) > -6k^ • m, ueUi. 

Dividing by 6 and taking 6^0, we have 

D(p{w) ■ Gu + n ■ u> eui ■ u for all u£Ui. 

Taking infimum over u ^Ui and using (2.15), we obtain TC^qo) < with 
qo = Dip{w). □ 

3. Generalized Brownian networks. Recently, in [7], Harrison and 
Williams considered a control problem for a Brownian network model and 
proved that it can be reduced to an equivalent but simpler control problem 
of a lower state dimension. In this section we note that the reduced control 
problem of [7] is a singular control problem with state constraints of the 
form introduced in Section 2 and prove that the standing assumptions of 
[7] imply those of the current paper (except for cases in which the reduced 
control problem is degenerate, i.e., the state space is a singleton). The data 
of a Generalized Brownian Network of [7] consists of the following: 

(a) Positive integers m,n,p specifying the dimensions of the state space, 
control space and control constraint space, respectively, for the Brownian 
network control problem. 

(b) A vector 6 G and a nondegenerate m x m covariance matrix S. 

(c) An m X n matrix R and a. p x n matrix K, which specify the ef- 
fects of controls on the state of the system and constraints on the controls, 
respectively. 

(d) A compact, convex set Z C M"* that has a nonempty interior, which 
specifies the state space of the network control problem. 
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The cost process for the network control problem is specified by a con- 
tinuous function h: Z and a vector v £ M". The key assumptions in [7] 
that are made on the network data and the cost are the following. 

Assumption 3.1 (Assumption 2.1 of [7]). {Ry: Ky >0,y eW^} = W^. 

Assumption 3.2 {Assumption 2.2 of [7]). 

{y eW^ : Ky > 0, Ry = and V y <0} = {0}. 

Lemma 4.3 of [7] shows that there is an m-dimensional vector vr and a 
p-dimensional vector k such that 

(3.1) v' = tt'R + k'K. 

Define M = {aeW": a'R = h'K for some 6 G RP}. This is called the work- 
load space in [7]. Let d be the dimension of M. Here we assume that d > 0, 
as we only treat state spaces for the reduced problem that have a nonempty 
interior. (The case d = is a degenerate case that can occur; however, in 
this case the reduced control problem dramatically simplifies to one where 
the cost effectively only varies with the control and not with the state.) Let 
M be a d X m matrix whose rows are a maximal linearly independent set of 
vectors in M. Denote by fC the range space of K. Define 

(3.2) W = {Mz:z^Z}, ^ = /CnM^, -3 = MO, T = MT,M'. 

Since M is of full row rank, it follows that W, like Z, is compact and convex 
and has nonempty interior. Set a = T^/^, a positive definite square root of 
r. Note that and a are state independent. Prom Lemma 4.2 of [7] we have 
that there is a d x p matrix G such that MR = GK. In this setting of a 
generalized Brownian network, we have the following. 

Lemma 3.1. Assumption 3.2 implies condition (1.8). 

Proof. Pix u^U such that Gu = and k- u<Q. Prom Lemma 4.4 of 
[7] (taking x = therein) there exists a y G M" such that u = Ky, Ry = 
and V -y = K-u. Prom Assumption 3.2 we now have that y = 0. Thus, u = Ky 
is zero as well and the lemma follows. □ 

Next, define the function g:W as 



(3.3) g{w) =M{h{z) +a7r ■ z:Mz = w,ze Z}, weW. 
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The following continuous selection requirement is the final main assumption 
of [7]. 

Assumption 3.3 {Assumption 6.1 of [7]). There is a continuous func- 
tion ip:W ^ Z such that, for each w G W, h{ip{w)) + air • tpi^w) = g{w) and 
Mil){w) = w. 

With the data k = d, d, p, W, U, G, i?, a, g and k, we now refer to 
our setting of Section 2: Admissible controls as defined in Definition 2.1 
and the value function V as defined in (2.7) comprise the reduced control 
problem of [7]. A minor difference from the setting in [7] is that there the 
control problem is formulated in terms of the process xt = wq + "^t + c-^t 
rather than in terms of Zt, however, since given wq there is a one to one 
correspondence between x ^'iid Z, the two formulations are easily seen to be 
equivalent. As a corollary of Theorem 2.1, we have the following. 

Theorem 3.1. Let Assumptions 3.1, 3.2 and 3.3 hold. Then V is the 
unique constrained viscosity solution of (2.12) on W. 

Proof. We first show that (1.2) holds. Fix ^ G . Since the rows of 
M are linearly independent, we can find x G such that Mx = ^. Prom 
Assumption 3.1 we can find a y G M*^ such that Ky > and Ry = x. Define 
u = Ky. Clearly, u The result follows on noting that Gu = GKy = 
MRy = Mx = i. 

Next, condition (1.8) holds by Lemma 3.1. Hence, (1.9) holds by Lemma A. 2. 
Using the equivalence of (iii) and (v) of Lemma A.l of the Appendix, we see 
that (1.5) holds as well. Pinally, let ui G be a vector of which all entries 
are p~'^/'^ . Since U C M^J., '^'i^iu&A:\u\=i lii • > 0. As a result [see the comment 
below (2.15)] we also have uiiu&AiUi • > 0, and condition (2.15) follows. 
The result is now established by Corollary 2.1. □ 

4. Dynamic programming principle and solvability. In this section we 
will prove (i) of Theorem 2.1. We begin by introducing the following canon- 
ical representation for the control problem which facilitates the use of reg- 
ular conditional probabilities in our proofs. Let £■ =P([0,co),yV x R^) x 
C([0, oo), M'^). The canonical coordinate maps on £ will be denoted by vrj, 
i = 1,2,3. Por example, for t G [0, oo), 7ri(t) : <S ^ W is defined as ■Ki{oj){t) = 
a;i(t) for to = (cJi, u;2, "^s) G £. The definitions of 7r2,7r3 are similar. Denote 
the triplet (vri, 7r2, vra) by vr. We will endow 8 with the Borel sigma field 
B{£). Denote by Vwo the class of all probability measures P* on {£,B{£)) 
satisfying the following: 

• Under P*, vra is a d-dimensional {.7^j}-standard Brownian motion, where 
J-'t is the canonical sigma field a{TT{s) '.0 < s <t}. 
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• 712 is locally of bounded variation and has increments in U, P*-a.s. 

• The following holds, P*-a.s: 

(4.1) 7ri{t)=wo+ ^7ri{s))ds+ f\{Tri{s))d7r3{s) + GTr2{t), t>0, 
Jo Jo 

where the second integral is an Ito integral; 



(4.2) 



E* 



Ik • 7r2(s)| ds 



< oo, 



where E* is the expectation operator corresponding to P*. 

In view of the fact that the value function is finite everywhere (Proposi- 
tion 2.1), we may restrict to controls for which J^wq, U) is finite. Since g is 
bounded on W, by Lemma 2.1(i) and the equivalent representation of the 
cost in (2.6), we can represent V as follows: 



inf E* 



e "'^ {g{T:i{s)) + an ■ iT2{s)) ds 



Restricting to F* that satisfy (4.2) considerably simplifies arguments in the 
proofs and the inequality (4.2) will be implicitly used at several places in 
the rest of this section. The following dynamic programming principle is key 
to the proof of part (i) of Theorem 2.1. 



Proposition 4.1. Fixwq^W, and denote = W\Bi;{wo). Fix e > 
such that is nonempty. Let 



(4.3) T = mi{s>0:TTi{s)^Bs{wo)}, n = t At,t £ [0,oo). 
Then for t G [0, oo), 

(4.4) E*(e-"^*|K-7r2(rj)|) <oo for all F* eVy,^ 
and 



Viwo) 



(4.5) 



inf E* 



/ e~"''[g{7ri{s))+aK-7r2{s)]ds 
Jo 



■e-''^'[Vi7r^iTt)) + K-7r2in)] 



Proof. Fix a P* G V^^ and t G [0, oo). Let Gg = J^s+ = Au>s^u for aU 
s £ [0, oo). Noting that Tt is a {^s}-stopping time, apply Lemma A. 4 with 
{Q.,T,P) in the lemma replaced by {£,B{£),¥*), X replaced by (7ri(rj + 
•))7'"2(Tt + •) - 7r2(rj),7r3(Tt + •) - 7r3(rj)), T replaced by £ and Q replaced by 
Qr^ . We denote the resulting regular conditional probability measure by P* 
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and the associated conditional expectation operator by E*^. For P*-a.e. u;, 
F*^{lj,-) is a probability measure on {£,13{£)). Denote 

i? = {^Gf :P;(t^,•)GP.l(nH)}■ 
Observe that, P*-a.s., for s > 0, 

rn+s 

7ri(Tf + s)= 7ri(Tt)+ / 'd{TTi{r])) dr] 

+s 

a{TTi{r])) d7Ts{ri) + G[Tr2{Tt + s) - 7r2(rt)]. 

Using the independence, under P*, of ir^iTt + •) ~ T^aiTt) from Qn, as follows 
from the fact that tt-^ is an {J^tj-standard Brownian motion under P*, we 
have that for P*- a.e. oj, under P*^(u;, •), ir^ is a d-dimensional {J^i}-standard 
Brownian motion. Also, P*-a.s., 



E! 



e • 7r2(s)| 



E* 



e "'\k- {712(3 + Tt)-TT2iTt))\ds 
/ e-"'\K-TT2is + Tt)\ds Grt 

Jo 



< E* 

+ a~^\K, ■ TT2{Tt 



< e"^*E* 



e • 7r2(s)| 



+ a ^\K-TT2{Tt)\ 

< 00, 

where the last inequality follows P*-a.s. from the fact that every P* E Vwo 
satisfies (4.2). In a similar fashion one can verify that the second and third 
bullets above Proposition 4.1 hold with P* there replaced by F*^{uj,-) and 
wq replaced by 7ri(Tt)(u;) for P*-a.e. uj. Combining these observations, we 
have that F*{E) = 1, and P*-a.s., that 



yK(ri))< e; 

(4.6) = E* 

= e"^*E* 
It follows that P*-a.s., 



e °'^{g{TTi{s)) + OK ■ Tr2{s)) ds 

POO 

/ e-'^'lginiis + Tt)) + UK ■ {tT2{s + Tt) - TT2{Tt))]ds Gr, 

Jo 



'[5'(7ri(s)) + OK ■ 7r2(s)] ds 



K ■ TT2[Tt) 



-art 



K-vr2(Tt)< e; 



(4.7) 



' (5(711 (s)) + OK ■ TT2{s)) ds 
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Using (4.2) and the boundedness of V on W, we now have that e~'^^*K-7r2(Tj) 
is bounded above by a P*-integrable random variable and, thus, 

(4.8) E*(e-"^*(K • Mn))^) < oo for ah P* G P.^,,. 

In particular, for fixed P* € Vwoi the expression on the right-hand side 
of (4.5) is well defined (possibly taking value — oo). An argument later in 
this proof [see (4.13)] will in fact show that (4.8) holds with (k • 7r2 (ri))"*" 
replaced by |k • 7r2(Tt)|. 

From (4.7) it also follows that the quantity 



E* 

is bounded below by 



oo 



e "^{g{Tri{s)) + OK ■ 'rT2{s)) ds 



e-"^(g(^i(s)) + ■ ^2(s)) ds + e-"^* [V{Mn)) + k ■ ^2(rt)] 



Taking the infimum over all P* G Vwoi we see that the left-hand side of (4.5) 
is bounded below by the right-hand side of the same. 

Next we establish the reverse inequality. Let 5 G (0, oo) be arbitrary. It 
is easy to see that there is a countable set C W and a measurable map 
Xs -.W ^ As such that XsiW^) C and sup^gyy \X5{w) -w\ <6. Define 
Xsiw) = Xs{w) — w, w G W. For each w & As, let P^^, G 'P„, be such that 



(4.9) E, 



oo 

„—as 



[g{7Ti{s)) + OK • 7r2(s)] ds 



< Viw) + 6, 



where E^^, is the expectation operator corresponding to the measure P^. Fix 
P* G Vwo- Let £2=£ ^ £ and let 9 = (9, 6) denote the canonical coordinate 
maps with 9= {9i,92,9^) and 9 = (6*1, 6*2, 6*3). More precisely, denoting a 
typical element of £^2 by = ifij-,^)^ we have for s G [0, 00), 9i{s){ijj) = Cji{s), 
9i{s){uj) =uJi{s), i = 1,2,3. Define ft(a),a3) =rf(a)). Then ft is a {Gt} stop- 
ping time, where = and J^l = cr{9{s) :s <t} for t > 0. Consider the 
probability measure Qwq on {£2,13{£2)), that for A,B £ B{£) satisfies 



two 



{AxB) = |^P,^(^^(,^„(i?)dP*(^) 



[Since Xs{9i{ft)) takes only countably many values (in Ag), this is a valid 
measure theoretic construction.] Define stochastic processes Z, U and W on 
(<52, S(<52), Qioo) such that, for s > 0, 

W{s) = 9i{s)l[o,r,){s) + Ms - rt)l[,,,oo)is), 

Uis) = 92{s)l[o,r,){s) + {92{n) + wCXsiMn))) + Ms - rO)l[f,,oo)(s), 

Z{s) = 93{s)l[o,r,){s) + (Ms - ft) + 93{ft))l[n,oc){s), 

where zu is as in Lemma 2.2. 
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Denote the measure induced by (W, U, Z) on (<5, B{£)) by f^o - It is easily 
seen that with Pt^,;, in place of P*, the first three bullet points of this section 
hold. Thus, from Lemma 2.1(i), 



(4.10) 



wo 



a{K ■ iT2{s)) ds 



< aL < oo, 



where E^„(, is the expectation operator corresponding to ¥y^Q and we have 
denoted by L the finite quantity in Lemma 2.1(i). Next note that 



wo 



(4.11) 



ae {k ■ 7r2{s)) ds 



ae-^%K ■ Mn) + wiXsiOiift))) + e2{s - nW ds 



From the above equality and (4.10) we have that 
IEQ.n(e""'H'^-^2(rt))-) 



(4.12) 



< aL + Cro|/«|5 + Er 



ae ""^ {k ■ 62{s - ft)) ds 



< 2aL + Crol^l^ < oo, 

where the first inequality uses Lemma 2.2 and the second inequality uses 
once more (4.10) and Lemma 2.1(i). Thus, we have shown that 

(4.13) E*(e-""'*(K-7r2(rt))~) < oo for all P* G ■ 

Combining (4.8) and (4.13), we have (4.4) and, consequently. 



E,„ 



e ■ ■K2{s)\ds 



< oo. 



In particular, recalling the properties of P^g stated above (4.10), we have 

e~°*[g(7ri(s)) + UK ■ 7r2(s)] ds 



that P^„o G Vuio ■ Next 



E, 



•wo 



(4.14) 

Also, 

E, 



:E* 



e '^^[g{7ri{s)) + aK • TT2{s)]ds 



wo 



e '^^[g{TTi{s)) + aK ■ TT2{s)]ds 



:Er 



(4.15) 



e-^'{g{e^{s-n)) 



+ aK ■ Mn) + ujiXsieiin))) + e2{s- ft)]} ds 
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-art 



[g{ei{s)) + aK-e2is)]ds 



■-T1+T2 



[e-''-'K-[e2{ft) + w{\s{ei{ft 



In splitting the expectation in the second equahty above, we have used (4.4). 
As an immediate consequence of Lemma 2.2, we obtain 

(4.16) T2 < E*[e"""*K • ^2(Tt)] + c^\k\5. 

Note that by the definition of Q^q , Ti can be rewritten as 



E* 



[g{TTi{s)) + aK ■ TT2{s)] ds 



From (4.9) and Proposition 2.1 we can bound the last expression from above 
by 

(4.17) E*[e-"^*y(A5(vri(Tt)))] + 6 < E*[e-"^*y(7ri(Tt))] + (cup + 1)6. 
Combining the above inequality with (4.15), (4.16) and (4.14), we obtain 



V{wo) < E„,o 
<E 



-as 



[g{TTi{s)) + aK ■ 7r2(s)] ds 



e ~°'^[g{7Ti{s)) + aK ■ tt2{s)] ds 

""im(Tt)) + K-7r2(Tt)] 



+ e 



+ (1 + ciip + Cro|K|)5. 

Letting 6^0 and taking infimum over all P* G Vwq , we obtain the desired 
reverse inequality. □ 

Proposition 4.2. V is a viscosity supersolution of (2.12) on W. 

Proof. Fix woeW and let ip G C^(>V) be such that V -tp has a global 
minimum at wq. We can assume without loss of generality that V{wo) — 
(p{wo) = 0. We need to show that either 

(4.18) £piwo)+aip{wo)- g{wo)>0 
or 

(4.19) inf{Gn • Dip{wo) + k ■ u:u eUi} <0. 

Arguing by contradiction, assume that neither of the above assertions is 
true. Then one can find 7 > and e > such that, for all w G B2e{wo) D W, 

(4.20) Cip{w) + aip{w) - g{iv) < --f 
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and Gu ■ Dip{w) + k • n > 7 for all u &Ui. Note that the latter implies that 

(4.21) Gu- D^{w) + K-u>j\Gu\ for all uG^/. 

Indeed, if \Gu\ > 0, this is immediate. If Gu = 0, let u be a vector in U 
such that \Gu\ = 1 [u exists by (1.2)]. Then for r > 0, u^ = u + ru £lA and 
\Gu'^\ > 0, and so (4.21) holds for u'^ in place of u, and sending r — > 0, it 
follows that (4.21) holds for u as well. 

Let t > and fix P* G Vwq- Let e, r, Tt be as in Proposition 4.1. An 
application of Ito's formula gives 

+ E* \ r e-"^[£(^(7ri(s)) + aip{TTi{s))] ds 



(4.22) 



•E* 



[0,rt] 



[V3(7ri(s)) - V9(7ri(s-))] 



0<S<Tt 

where 'q^{s) = Gg^{s), and £»'^(s) = (vr2(s) — J2o<r<s ^'^2{''')) for s > 0, and 
vri(O-) = ujo, A7r2(0) = 712(0). Let 



Vn^,,e = {F* G Vy,, : P*{r < oo,7ri(r) ^ S2,(t/;o)} = 0}. 
From (4.21) we obtain, for P* G P^g^^ and s G [0,Tf], 

V7(7ri(s)) - 99(7ri(s-)) = / Dip{Tri{s-) + rA{GTT2is))) ■ GATr2is) dr 

(4.23) 

>7|A(G7r2)(s)| -K- A7r2(s), P*-a.s. 

Note that in (4.23), 7ri(s-) + rA(G7r2(s)) G W for ah r G [0, 1] since W is 
convex. Since ^2 has increments in Z//, it is elementary to check that so does 
its continuous part g^. As another consequence of (4.21), we have, P*-a.s. 
(for F*€V^,,s), 



(4.24) 



'L'(^(7ri(s))-dr/^>7e-"*|7?^i 



[0,rt] 



Combining the above two inequalities, we obtain 

/ e--^D^{n^{s))-dt+ E e— ((^(7ri(.))-^(^i(.-))) 



Q<S<Tt 



>7e-°*|G^: 



2|rt 



[0,n] 



: 76 



-at 



' (i(K • 7r2(s)) 

"k ■ 712(5) ds — e~"'^^K ■ 7T2{t), 
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where the last equahty fohows from the integration by parts formula (2.2). 
Using the above inequality and (4.20) in (4.22), we obtain 

ifiwo) < E*[e-"-V(7ri(n))] 



Tt 







e""'[ff(^i(s)) + an ■ ^2(5)] ds + e-°"'*At • 712(1) 



-7e-°*E*[rj + |G7r2|.J. 

Once again, in splitting the above expectation, we have used (4.2) and (4.4). 
Taking the infimum over all P* G 'Pwo,£, in the above inequality, we have 

(4.25) ipiwo) < ^ini J(F*) - ^e-^'m, 

where 

J(P*) = E*[e""^*y(^i(rt))] 
+ E^ 



(4.26) 



"'e-"^g(^i(s))ds+ / e~''' d{K ■ TT2is)) 

[0,rt] 



(3{t) = infp*g-p^^ ^ ]E*[rf + |G7r2|rt], and we have used the fact that ip <V va. 
W plus the integration by parts formula (2.2). Using Lemma A. 3 in the 
Appendix, the infimum on the right-hand side of (4.25) can be replaced 
by the infimum over all of Vwo- Thus, applying Proposition 4.1, we obtain 
lp{wq) < V{wo) - 7e-"*/3(t). Finally, to arrive at a contradiction, we show 
that 

(4.27) there exists t > such that /3(t) > 0. 

Fix F* G Vwo,e- Then |7ri(rt) — wq\ > e on {r < t}, P* a.s. Thus, denoting 
=/o^(^i('5))^^3(s) and li^lw = maxa;gw |i?(x)|, 

W.*[\GTT2\rA{r<t}] > E* [| G7r2 (t*) | l{,<t}] > E* [(^ - t|^9|w " \r\:)l{r<t}]- 
Hence, for t G (0, (3|i9|>v)"^e), 

^*[rt + \Gtt2U> tF*{T >t) + (e/3)P(r <t, |r|* < e/3) 
>[tA(e/3)r(|r|*<e/3). 

Clearly, for ah t > smah enough, P*(|r|j < e/3) > 0. This proves (4.27) and 
hence the result. □ 

Next, we prove the subsolution property of the value function. 



Proposition 4.3. V is a viscosity subsolution of (2.12) on W°. 
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Proof. Fix wq G >V° and let tp £ C'^{W°) be such that V - has a 
global maximum on W" at wq. Once more, we can assume without loss of 
generality that ^p{wo) = V{wo). Thus, V < if on W°. We need to show that 
C{w) = aif{w) + C<p{w) — g{w), w G W satisfies 

(4.28) Ciwo) < 
and 

(4.29) Gu-Dip{wo) + K-u>0, ueUi. 

For all 5 > small enough, one has wq + dGu G >V° for all u gUi. By 
Lemma A. 3, 

f{wo + 6Gu) — f{wo) > V{wo + 6Gu) — V{wo) > —Sk • u, u gUi. 

Dividing by 6 and taking (5 — > proves (4.29). 

Now consider (4.28). Let e > be such that Be{wo) C W". Let 

= lAM{t>0:TTi{t)^Bs{wo)}. 

Now let P* G Vu^o be such that P*{7r2(t) = 0,t G [0,r^]} = 1. Such P* exists 
by standard results on existence of solutions to the SDE (4.1) with tt2 = 
and by the controllability condition (1.2) (for the behavior after r^). An 
application of Ito's formula gives 

V{wo) = ip{wo) = E*[e-°^V(7ri(T^))] 

(4.30) 



[Cip{TTi{s)) + aip{TTi{s))] ds 



Using Proposition 4.1, V <ip, and the above, we obtain 



V{wo) < E* 



(4.31) 



<^(^^o)+E* 



'5(vri(s))(is + e-"^V(^i(r^)) 



'b(^i(s)) -'C(/5(7ri(s)) - aip{TTi{s))]ds 



Recalling that V{wo) = ip{wo), we have E*[/J' e '^'^Ci'^^iis)) ds] < 0. Hence, 



r e-'^'ds 


< E* 


\f 


Jo 




Jo 



< a{wo,e)K* 



^{awo)-C{7ri{s)))ds 



'ds 



where 



: rnax \C{w) - C{wo)\. 



Since > P*-a.s., it follows that C(^o) < a(i(;o,e)- Taking e — > 0, we ob- 
tain (4.28) by the continuity of ( on W°. □ 
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5. Uniqueness. In this section we will prove part (ii) of Theorem 2.1. It 
will be a special case of a result that involves more general convex Ti that 
we now formulate. The state space W is assumed to be a closed, bounded 
subset of satisfying the condition 

for every ^ G W, there exist r/ = r/(^) € and a = a(^) > such that 

(5.1) 

Bta{w + tT]) C >V°, for all u; G W n Ba(i) and all t G (0, 1]. 

As shown in Lemma 6.1 of [1], any compact convex set with nonempty inte- 
rior meets this condition. It is also satisfied by the closure of any bounded 
Lipschitz domain (in the sense of [2], Chapter III). Indeed, let W be the clo- 
sure of a Lipschitz domain. For ^ G W°, (5.1) obviously holds. Next, given 
^ G 9yV, there is ai > 0, a Lipschitz function / : W^~^ — > M, and a coordinate 
system CS such that >V° n Ba^ (^) = {?/ G Ba^ : yi > f{y2, yd)}, where, 
for y G M"^, {yi, . . . ,y^) represents y in the coordinate system CS. It is not 
hard to check that for a > small enough (depending only on ai and the Lip- 
schitz constant of /) and r] = aei (in CS), one has yi > f{y2, ■ ■ ■ ,yd) when- 
ever y = w + tr] + taz, te (0,1], zGM'', \z\ < 1, w G W n 5a(^). Thus, (5.1) 
holds. 

Next, we allow a and 7i to depend on x, and assume that for some 
C G [1, oo) and a function uj : M+ ]R_|_ with vanishing right limit at [i.e., 
a;(0-|-) = 0], one has 

(5.2) \a{x)-a{y)\ + \i^ix)-{^{y)\ + \a{x)-a{y)\<C\x-y\, x,yeW, 

(5.3) a{x)>ao>0, x G W, 
\gix) - giy)\ + \n{x, q) - n{y, q)\ < u;(|x - y\), 

(5.4) 

x,y£W, gGM"^. 

(5.5) \nix,qi)-n{x,q2)\<C\qi-q2\, x G W, (?2 G M^. 

Recall that T = aa' . The constant C > 1 will be assumed to be large enough 
so that 

(5.6) \a{x)\ + \^{x)\ + \r{x)\ + \a{x)\<C, x G W. 

It is also assumed that q i-^ TC{x,q) is convex for every x G W. For n G N, 
denote by S(n) the space of symmetric n x n matrices, and write " < " for 
the usual order on S(n) [for A,B £ §>{n), A < B and only B — A is 
nonnegative definite]. For x G W, r G M, g G M"^ and A G §>{d) denote 

F{x, r, q, A) = a{x)r — i9(x) • q — ^trace(r(x)j4) — g{x). 
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The comparison result below regards solutions to the equation 

(5.7) F{x,ip,Dij,D'^'ilj)vn{x,Dij)=0, 

defined with state constraint boundary condition (analogous to Definition 2.2) 
Since the left-hand side of (5.7) is not strictly increasing in the tp variable 
(because the term 7i does not depend on this variable), the argument for 
comparison will rely on the existence of appropriate strict subsolutions (cf. 
Section 5C of [3]). We therefore assume the following: 

there exists a constant 7 > and a function ipQ G C^(W) such that 

(5.8) 

n{x,DMx))<-l, x£W°. 



Theorem 5.1. Let conditions (5.1)-(5.5), (5.8) hold, and let v he a 
subsolution of (5.7) on W° and let v be a supersolution of (5.7) on W. 
Then 

(5.9) v<v, onW. 

In the special case where 7i{x,q) is independent of x, condition (5.8) is 
easily seen to be equivalent to (1.7). Also, for this case, if miy^^d7i{q) > 0, 
then the problem degenerates in the sense that every continuous function is 
a viscosity supersolution, and moreover, from any viscosity subsolution tp, 
we can produce subsolutions ip — c, c > 0. These comments are summarized 
in the following. 

Corollary 5.1. Assume H{x,q) = H{q), x eW, qe M°', and let condi- 
tions (5.1)-(5.5) hold. Let there exist a constrained viscosity solution to (5.7). 
Then inf^gj^d Tii^q) < is necessary and sufficient for uniqueness of such so- 
lutions. 

Proof of Theorem 5.1. We introduce some notation specific to the 
proof. Let S* be a relatively open subset of W. For x & S (ZW and a real 
valued continuous function -i/; on W, let the corresponding second order 
super jet and sub jet be defined as follows [here we follow the terminology and 
notation of [3]; these objects are not to be confused with the cost functional 
J of (1.3)]: 

fs^^{x)={{D^{x),D\{x)): 

if € C^(S') and ip ~ ^ has a local maximum at x}, 
4'-Hx) = {{D^ix),D^^{x)): 

(f E C^{S) and ip — (f has a local minimum at x}. 
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Define the closures of the above sets in the following way. For x € S, 
j'^S^^I;{x)={{q,M)£R'^ x S(d) : 

there exists a sequence (x„,, qn, Mn) G W x M'^ x S(ci) s.t. 

(g„,M„,) G j|'"^-0(a;n), and 

{xn,il^{xn),qn,Mn) ^ {x ,tp{x) , q, M) as n ^ oo}. 

Define ■(/'(x) analogously. For short, write J^'"*^ for and similarly 

define J^'~, J^'^ and J^' . 

Let 7 and be as in (5.8) and set ij^i = — ci, where the constant ci 
is large enough to ensure that 

F(x,Vi(x),L»Vi(2;),i?'^i(2;)) < -1 

(5.10) 

and Vi(^) ~ ^(^) ^ foi' ^ ^ 

By (5.8), 

(5.11) W(x,£>V'i(^)) < -7, xGW. 
For [5 £ (0, 1) define 

(5.12) y^=py+^l-f3)^^. 

It suffices to show that, for every /3 G (0, 1), 

(5.13) V(3{x)<v{x), xGW. 

We argue by contradiction and assume that (5.13) does not hold. Therefore, 
there exist f3 £ (0,1) and ^ G W such that 

(5.14) v^iO - v{0 = max('i;^(x) - v{x)) = 6>0. 

We will first argue that if z G W° and {q,A) G J ' Vf^iz), then 

(5.15) F{z,Vfs{z),q,A)<-{l-/3), n{x,q) < -{1 - (3)-f. 

To this end, consider first, {q,A) G J'^'^vp{z). Let (p G C^(>V) be such that 
q = Dip{z), A = D'^ip{z) and vp — Lp has a local maximum at z. Let 

^=r'(v'-(i-/3)^i). 

Then v — (p = [5~^{vp — Lp) has a local maximum at z. Let g* and A* be such 
that q* = Dp{z), A* = D^^{z). Note that 

(5.16) q = pq* + {1- f3)DMz), A = pA* + (1 - p)D^Mz)- 

Then {q*,A*) G J'^'^v{z). Using the subsolution property of v (cf. Defini- 
tion 2.2 and the text immediately following it), 

(5.17) F{z,viz),q*,A*)<0. 
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Noting that the map {r,u,X) F{z,r,u, X) is afRne and combining (5.10), 
(5.12), (5.16) and (5.17), we obtain the first inequahty in (5.15). Now since 
z £ yV° and {q,A) G j'^'^vp{z) are arbitrary, and F is continuous in all 
variables, the first inequality in (5.15) holds, in fact, for all z € and 

iq,A)GJ^'^vp{z). 

By convexity of q>-^TC{z,q), (5.11) and using once more the subsolution 
property of v and the continuity oi TC, it is seen that 

n{z, q) < pn{z, q*) + (1 - (3)n{z, DiJi (z)) < -(1 - /?)7, 

2 + 

for all {q,A) G J ' Vf3{z) and z G W. This proves the second inequality 
in (5.15). 

Recall that ^ is chosen such that (5.14) holds. Let r] = r/(^) be as in (5.1). 
For 7 G (1, oo) and e G (0, 1) set 

^{x,y) = |7(x -y)- eif + e\y - Cp, 

$(x, y) = vp{x) - v{y) - ^{x, y), {x, y) E W x W, 



and let 



{x~,y~) = {x,y)e argmax ^{x,y) 

{x,y)eWxW 



{u,w) :^{u,w) = max ^{x,y)>. 

(x,y)GWxW J 



By (5.1), 

(5.18) ^+|r/GW". 

7 

Clearly, $(x,y) > + 'y~^e7],^). This can be rewritten as 

(5.19) vp{x) - v{y) -vp(^S, + |r?^ + v{(,) > \^{x -y)-er]\'^ + e\y - ^p. 

Dividing by 7^, we see that, for every e, |2? — y| — >0 as 7^00. This obser- 
vation, along with (5.14), (5.19) and the continuity of vp and v, gives that 
limsup;^;^^ \ j{x — y) — er/P + e|y — < 0. Hence, for all e G (0, 1), 

(5.20) y— >C) 7(2? — y)— as7— >oo. 
In particular, 

(5.21) x = y + 7"^eT/ + 7"^o(l) 

as 7 — > 00. Hence, by (5.18) and (5.1), x £ W° for 7 > 70, for some 70 = 
70(e) < 00. By (5.10), (5.12) and (5.14), it follows that v{i) < v{S,). By choos- 
ing 7o larger if necessary, we have v{y) < v{y) for 7 > 70. Henceforth, assume 
7 > 70. For (x, r,q,A) eW xM.xR'^ X §{d) let 

F{x, r, q, A) = F{x, r, q, A) V W(x, q). 
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Since x G W°, we have from (5.15) 

F{x,Vf3{x),q,X) < -e*, {q,X) £7^'~^v/3{x), 
where e* = (1 — A 7). By the supersolution property of v, 

F{y,v{y),q,Y) > for all {q,Y) eJ^'- v{y). 

Combine the above two displays and use the inequality (a V 6) — (c V d) < 

(a — c) V (6 — d), {a,b,c,d) E M^, along with (5.2)-(5.6), to obtain, for all 

2 + 2 — 

G J ' Vf3{x) and {q2,Y) G J ' v{y), 

(5.22) e* < F{y,v{y),q2,Y) - F{x,Vfs{x),qi,X) < Ai V A2, 

where 

Ai =uj{\x-y\) +C\qi -92!, 

A2 = C^\x -y\+ a{x){v{y) - Vfsix)) + C\x - y\ \qi\ 

(5.23) 

+ C\qi-q2\ +u:{\x-y\) 

+ itrace(r(x)X-r(y)y). 

With an abuse of notation, we used the symbol C in the above display for 
C V maxw \ v\ (and will keep this notation). Next, noting that 

vi3{x) - v{y) > ^{x,y) > ^>(e,6: 

and using (5.14), we have 

(5.24) v{y) -vpix) <e'^\r]f. 

Hence, by (5.23), 

A2 < C^\x- y\{l + \qi\) + Ce^M^ + C\qi - gal + uj{\x - y\) 

(5.25) 

+ itrace(r(x)X-r(y)y). 

We now estimate the last term in the above display. By Theorem 3.2 of [3], 
since ^ has a (local) maximum at {x,y), for each g £ (0,oo), one can find 
X,Y £ §{d) such that 

{D,^{x,y),X)eJ^'^Vf,{x), {-Dy^{x,y),Y)eJ^'-v{y), 
and, with the usual order on §(2d), 

(5.26) (^^ _^y^<D^-i'ix,y) + Q{D^^{x,y))^. 

Observing that 

L>a;*(x, y) = 27(7(x - y) - erj), 

(5.27) 

-Dy^{x,y) = 27(7(2; - y) - ei]) - 2e{y - 
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and 

(5.28) DH{x,y) = 2j'^^^ 5)' 

we can rewrite (5.26) as 

(^ -/) 

(5.29) 

+ 4fe,(_0^ -/)+(2e + 4,e^)(;; J). 

Note that A,B £ §(2d) are nonnegative then trace(^-B) > 0. Arguing sim- 
ilarly to Example 3.6 [3], we use this fact along with (5.29) and the nonneg- 
ativity of the symmetric matrix 

/a{x)a{x)' a{y)a{x)'\ 
\a{x)a{yy a{y)a{y)' ) 

to obtain 

trace(r(x)X - T{y)Y) 

= trace(cr(x)cr(x)'X - a{y)a{y)'Y) 

< (272 + 8£.74)trace((a(5;) - a{y)){a{x)' - a{y)')) 

+ 872e£>trace(o-(y)((7(y)' - cr{x)')) + (2e + AQe^)iT:ace{a{y)a{y)') 

< (27^ + 8£»7^)C'|x - y|2 + SC^'^eQ\x -y\ + (2e + Aq£^)C , 

where C = {dCf. By (5.22), (5.23), (5.25), (5.27) and the above estimate, 
substituting q = 7"^, we have for e < 1, 7 > (1 V 70), 

e* < [C{l + 2-^o{l))+ACe\\x-y\+b^'^C\x-y\^ 

+ 2cu(|x -y\) + ACe{l + \y-i\) + Ce''\r^\\ 

where, as in (5.21), we wrote o(l) for a function (possibly depending on e) 
converging to zero as 7 ^ co. Let 7 ^ cxo and use (5.20) and (5.21) to obtain 

e* <6Ce2|ryp + 4Ce. 

Finally, letting e ^ we arrive at a contradiction. Hence, (5.13) and, in 
turn, (5.9) must hold, and the result follows. □ 

APPENDIX 

Lemma A.l. The following are equivalent: 

(i) 7^(0) <c3o. 

(ii) W(g) < cxD for some q^W^ . 

(iii) n{q)< 00 for allqeM'^. 

(iv) There exists ci G (0, cxo) such that (k ■ u)~ < ci\Gu\ for all u^li. 
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(v) The set {u £U : \Gu\ <£,k-u< —1} is empty for all e > sufficiently 
small. 

Proof. The equivalence of (i), (ii) and (iii) is immediate on noting that 
\Gu ■ q\ < \q\ for ah u^Ui. 

Note that if for some c G (0, oo) one has, for every uGU with Gu ^ 0, 



then (A.l) holds for every u Indeed, if Gu = 0, let u be a vector in U 
such that \Gu\ = 1 [u exists by (1.2)]. Then for r > 0, u'^ = u + ru £ U and 
\Gu^\ > 0, and so (A.l) holds for u^' in place of u, and sending r — > 0, it 
follows that (A.l) holds for u as well. 

Note that the following holds: ?Y(0) < sup^g^^^ (k • n)^ < (W(0))+. The im- 
plication (iv) (i) is immediate from the first inequality above. Conversely, 
if (i) holds, then the second inequality above, along with the argument of 
the last paragraph above, gives (k • u)~ < {7i{0))'^\Gu\ for every u gU, and 
(iv) follows. 

Suppose now that (v) holds. Then there exists an e > such that for 
uGlA satisfying \Gu\ < e we have (k • u)~ < 1. In particular, for any u^U 
with \Gu\ / 0, 



Thus, by the argument given in the second paragraph of this proof, (iv) 
holds. Conversely, suppose that (iv) holds. Then (k • u)~ < 1 for all u £U 
satisfying \Gu\ < (2ci)~^. In particular, the set in (v) with e = (2ci)~^ is 
empty. We have thus established the equivalence of (i)-(v). □ 

Lemma A. 2. Condition (1.8) implies (1.9). 

Proof. Note that the result holds trivially if k = 0. Assume now that 
At 7^ and suppose that (1.9) fails. Then we can find a sequence {n„,} con- 
tained in li such that Gun and k • u„ < — 1. Note that \un\ is bounded 
from below by \k\~^ . Let Un = Un\un\~^ ■ Clearly, Gun — > and /c-iin < 0. Let 
Un converge to n along some subsequence. Then w is a unit vector satisfying 
Gu = and k - u<0. Thus, (1.8) fails. This proves the result. □ 

Proof of part (ii) of Lemma 2 . 1 . Note that by item (iv) of Lemma A.l, 
(k • Ut)~ < ci\GUt\ < ci\At\, for all t > 0, where 



(A.l) 



{k • u) < c\Gu 



(A.2) 



(k-u)- <e-^\Gu\. 




From the boundedness of W we have that, a.s., /[qcxd) 
e~"^At ^ as t ^ oo. Thus, we obtain that a.s., /^q c 



e "^{Afldt < oo, and 
ae~°'^{K-Us)~ ds <oo 
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and e~°'^{K • Ut)~ — > as t — > oo. In order to prove the assertion, it therefore 
suffices by (2.2) to show that if /[o oo) °^^~"*('^ ' Ut)~^ dt < oo, then e~"*(K • 
Ut)~^ — > as t ^ oo. The proof of this last statement fohows the proof of 
Lemma A. 4 of [7]. In particular, replacing f by k and Y hy U therein, we 
obtain in case (a) of the proof of that lemma [and the subcase where (100) 
there holds] that, for all n sufficiently large, 

K • AnU < -Z£^e"^2"+i < 0, 
1 + e 

using the notation of [7]. Thus, 

< {k ■ A„[/)-e~"^2n+i 

< ci|GA„f/|e"""'2"+i 

< C2(| A„Z| + \AnW\ + A„t)e-"^2"+i , 

where Zt = Jq a(Wu) dZu and C2 is a suitable positive constant. Since a.s., 
T2n+i — > oo as n — > oo, and A„t = T2n+2 — T2n+i < 5 for all but finitely many 
n, the right side above converges a.s. to 0, as n — > oo, due to the compactness 
of the state space and the asymptotic properties of Brownian motion. Thus, 
— 0) which is a contradiction since both e and b are positive. Other cases 
are treated exactly as in [7], Lemma A. 4. □ 

Lemma A.S. (i) Let wGW and ugU. Ifw + Gu£W, then 

V{w + Gu) + K-u> V{w). 

(ii) Let T, e, wq and Vwo,£ be as in the proof of Proposition 4.2. Then 
infp.ep^^^^ J(P*) =infp.ep^^j J(F*), where J(P*) is as defined in (4.27). 

Proof, (i) Let U G A{w + Gu). Then U = u + U€ A{w). Also, 

V{w)<J{w,U) = J{w + Gu,U) + K-u. 

Since U £ A{w + Gu) is arbitrary, the result follows. 

(ii) Fix P* GVwq - Define stochastic processes {W,U) on {£,B{£)) as 

W{s)=7ri{s), C/(s)=7r2(s), sG[0,t), 

and on the set {r < oo} define 

e* = inf{5 G [0, 1] : W{t-) + 5GA7r2(r) ^ B2e{wo)} 

when this latter set is nonempty, otherwise set e* = 1. Let 

Wir) = Wir-) + e*GA^2(r), U{t) = 7r2(T-) + e*A7r2(r). 
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We leave {W,U) unspecified on (r, oo); they can be defined in an arbitrary 
way, as long as U £ Ajt up) with system = [£,B{£),{Tt},'\P*,TT3), r = 
mf{t > : W{t) ^ Bi;{wq)}, and (4.2) holds. Let P* be the measure induced 
by {W,U,TTs) on {£,B{£)). Then P* G Vnjo,e- Finally, note that, setting p = 
(1 — e*)A7r2(r)l{T-<oo}5 we have from the first part of the lemma that 

J(r ) - J(r ) = E*[l|,<,} e-"-[K • p + y(7ri(T)) - V{7t,{t) - Gp)]] > 0. 
This proves the lemma. □ 

The following well-known result is included for the sake of completeness. 
For a proof, we refer the reader to Theorem 10.2.2 (page 345) of [4]. 

Lemma A. 4. Let {0,,J^,P) be a probability space, T be a Polish space, 
B{T) be the Borel sigma field on T, and X -.Q be a measurable function. 
Let Q be a sub sigma field of T . Then a regular conditional probability distri- 
bution for X given Q exists, that is, there is a function P : O x B(T) — > [0,1] 
such that, for P-a.e. u G fi, P{uj,-) is a probability measure on {T ,B{T)); 
for each A S B{T), P{-,A) is Q-measurable, and for all C €Q and A G B{T), 
P{C n{Xe A}) = j(j P{oj, A) dP{u)) . 
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